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Abstract. - We report a novel mechanism for the occurrence of chaos at the macroscopic 
level induced by the frustration of interaction, namely frustration-induced chaos, in a non- 
monotonic sequential associative memory model. We succeed in deriving exact macroscopic 
dynamical equations from the microscopic dynamics in the case of the thermodynamic limit and 
prove that two order parameters dominate this large-degree-of-freedom system. Two-parameter 
bifurcation diagrams are obtained from the order-parameter equations. Then we analytically 
show that the chaos is low-dimensional at the macroscopic level when the system has some 
degree of frustration, but that the chaos definitely does not occur without the frustration. 



The occurrence of chaotic behaviors at the macroscopic level has been extensively investi- 
gated, and thus its mechanisms can be classified into several classes according to their typical 
systems. Examples of the first class are the globally coupled map (GCM) and chaotic neural 
networks whose processing units are themselves chaotic, and the macroscopic behaviors are 
also chaotic ^BH^lEl- Since the processing units are chaotic, the chaos at the macroscopic 
level seems to be high-dimensional. However, large-scale computer simulations show that the 
dimension of the chaos in the GCM can be lower than the degree of freedom 4 . In the 
other class of mechanisms, the processing units are not chaotic themselves, and thus resultant 
macroscopic chaotic behaviors would seem to be induced by other properties. A typical ex- 
ample of this class is that of neural networks. Since their processing units are simple binary 
units, their chaotic behaviors should be induced by additional mechanisms, that is, synaptic 
pruning, synaptic delay, thermal noise, sparse connections and/or so on [SJ|21[7j. Frustration 
is worth notice as inducing chaos. For continuous systems, chaotic behaviors can be analyzed 
in some small networks with frustration of interaction at the microscopic level |8ll9lll0| and 
random neural networks at the macroscopic level Here, we report a novel mechanism 

of the occurrence of chaos at the macroscopic level induced by the frustration of interaction, 
namely frustration-induced chaos, for discrete system. 
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We discuss a non-monotonic sequential associative memory model. The sequential asso- 
ciative memory model is a neural network, in which the sequence of patterns is embedded 
as an attractor through the Hebbian (correlation) learning |12lll3lliHll5| . When the number 
of the patterns, p, is on the order O(N), where N is the number of the processing units, 
the model has frustrated interactions [lfi| . Previously, the properties at stationary states had 
been exactly analyzed by the path-integral method [lHlUlj because the theoretical treatment 
of transient dynamics was difficult. However, we recently succeeded in rigorously analyzing 
the transient dynamics of the model |15| . 

It has been reported that the non-monotonicity of processing units (a larger absolute 
value of local field tends to make their state opposite to the local field) gives the systems some 
superior properties, e.g., an enhancement of the storage capacity, few spurious state, and a 
super retrieval phase |17lll8lH^] . An interesting one is chaotic behavior: Results of numerical 
simulations showed that the systems with non-monotonic units have chaotic behaviors. In 
particular, chaotic behavior was observed when the retrieval process failed. Dynamical theories 
are indispensable to analyzing these chaotic behaviors. Only approximated theories, e.g., 
Gaussian approximation |12I19U2(JI22II23I21| or steady-state approximation [131114) . have been 
employed to investigate the occurrence of these chaotic behaviors theoretically since 
theoretical treatment was difficult as mentioned above. Consequently, the occurrence of these 
chaotic behaviors has never been analyzed rigorously. 

In this Letter, we extend our exact dynamical theory |15) for the sequential associative 
memory model to a non-monotonic one to discuss the occurrence of chaos. We have succeeded 
in obtaining an exact description of its macroscopic dynamics and proved that two order 
parameters dominate this model. We obtained two-parameter bifurcation diagrams from 
the order-parameter equations and analytically demonstrated that the chaos of the present 
system is low-dimensional at the macroscopic level. We also analytically show that the chaotic 
behavior is observed when the retrieval process fails, and prove that the chaotic behaviors 
in this system occur only when it has some degree of frustration. This means that this 
macroscopic chaos is induced by the frustration, that is, it is frustration-induced chaos. 

Let us consider a sequential associative memory model that consists of N units or neurons. 
The state of the units takes <7j(t) = ±1 and updates the state synchronously with the following 
probability: 

Prob[o-i(t+l)|/K(t)] = ±[l + *i(t + l)F(hi(t))], (1) 

N 

hi(t) = J2JiJVi(t)+Ht), (2) 

3=1 

where is the coupling, Ii(t) is the threshold or external input, and hi(t) is the local field. 
The function F (h) is a non-monotonic function given by 

F (h) = tanh 0h - tanh (3 (h - 9) - tanh /3(h + 6), (3) 

where j3 is the inverse temperature /3 = 1/T, and is the non-monotonicity. When T — > 0, 
update rule of the model becomes deterministic, 

ai(t + 1) = sgn {Kit)) - sgn [h t {t) -9)- sgn (h^t) + 9) . (4) 

When the absolute value of the local field is larger then 9, the state has opposite sign to 
the local field, i.e., <Tj(t + 1) = — sga(hi(t)). The coupling J.^ stores p random patterns 
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€ P = (£1 ) " " ) £jv) T so as to retrieve the patterns as £° — > — > ■ • • £ p 1 — > £° sequentially. It 
is given by 

where £ p = £ . The number of stored patterns p is given by p — aN, where a is called 
the loading rate. Each component of the patterns is assumed to be an independent random 
variable that takes a value of either +1 or —1 according to the following probability, 

Probftf = ±1] = ~. (6) 
We determine the initial state <x(0) according to the following probability distribution, 

PlobM0 ) . ± 1] . 1±J^. (7) 

The overlap being the direction cosine between <r(0) and £° converges to m(0) when N — > oo. 

In order to discuss the transient dynamics, we introduce macroscopic state equations by 
the path-integral method |13U14llT5| . The generating function Z[if>] is defined as 

Z[1>] = VJ P[o-(0),o-(l),--- )O -(f)]exp(-i^o-( S )-^( S ) J , (8) 

where tp — (i/>(0), • • • , tff(t — 1)). The state cr(s) = (ci(s), ■ • • , <tn(s)) t denotes state of the 
spins at time s, and the path probability p [<r(0), <r(l), c(t)} denotes the probability of 
taking the path from initial state c(0) to state a it) at time t through er(l), er(2), • • • , exit — 1). 
Since the dynamics Q is a Markov chain, the path probability is given by 



p [o-(O), <r(l), • • • , ait)] = p [<x(0)] J] J] ~ [1 + cnis + 1)F (/*(«))] . (9) 

s<t i 

The generating function Z[ip] involves the following order parameters: 



<*.« - -nsgwW ,12) 

The order parameter m(s) corresponds to the overlap, which represents the direction cosine 
between the state tr(s) and the retrieval pattern £ s at time s. G(s, s') and C(s, s') are the 
response function and correlation function between time s and s', respectively. Therefore, the 
problem of discussing the macroscopic transient dynamics eventually results in the problem 
of evaluating the generating function. We consider the case of thermodynamic limit N — > oo 
and analyze Z[ip] by the saddle point method. Since N — > oo and the stored patterns £ M are 
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random patterns, we assume self-averaging, such that Z[xp] can be replaced with its ensemble 
average Z[if>]. We can, therefore, obtain a rigorous solution by the path-integral method |15| . 
Finally we obtain following macroscopic state equations from Z[tp] when Ii(s) = 0: 



m(s) 



£_ s J DzF (£, s m(s - 1) + zy/aR(s-l,s-\)} 



(13) 



R(s,s') = C(s,s') + G(s,s- l)G(s',s'- l)R(s - l,s' - 1), 



G(s,s-1) 



y/ aR(s — 1, s — 1 



l^j DzzF (£ s m(s - 1) + z^aR{s -l,s- 1))^ 



(14) 



,(15) 



C(s,s') = ( [ — — r ex P 

\J 27rLRn * 



~2 Z ' R ^ z 



F (e s m(s - 1) + y/az{8 - 1)) 



(£ s 'm(s'-l) + ^(s'-l))) , 



(16) 



where Dz = 



exp[ 



1 ,21 



and (-)j denotes the average over all £'s. The matrix i?n is a 2 x 2 

matrix consisting of the elements of R at time s— 1 and time s'—l, and z = [z(s— 1), z(s'— 1)] T . 
From equations 1(13 )1 -l(T5 )l . C(s,s') = and R(s,s') = when s 7^ s'. Since G(s,s — 1) and 
C(s, s) can be described using only m(s — 1) and R(s — 1, s — 1), macroscopically this system 
is a two-degree-of- freedom system of m(s) and i?(s, s). 

Besides these dynamic macroscopic state equations, the fixed points of the system are 
required in order to analyze the bifurcation of the system. We set m(t) — > m, G(t,t — 1) — > 
G, R(t, t) — ► r when t — > 00. Then, the previously obtained stationary state equations (131111] 
arc rc-dcrivcd from our dynamic theory, 



■m 



G 



£ J DzF [£m + zyfar\ 
^= I^J DzzF [£m + z^/af] 



1 -G 2 ' 



(17) 
(18) 
(19) 



From our macroscopic state equations (|13|l - l|16|) . we analyze the transient dynamics in 
the case of absolute zero temperature T = 0. Figure [T] shows the transition of the overlap 
m(t) and the variance of the crosstalk noise aR(t,t). The figures show the results obtained 
by (a) our theory, and (b) computer simulations with N = 100000, where the loading rate is 
a = 0.065 and the non-monotonicity 9 = 1.20. The cross marks P, P', Q are fixed points. The 
point Q on the line m — is a saddle node (orientation reversing), P' is a repellor (unstable 
node), and P is a repellor (unstable focus). There is a period-2 attractor Q2- The attractor 
Q2 attracts the trajectories with initial state m(0) w 0. Moreover, there is a chaotic attractor 
around the repellor P. The Lyapunov exponent of the chaotic attractor, which can be easily 
calculated from the equations (|13fl - l|16[) . is positive i.e. 0.038. The results obtained by the 
theory agree with those of the computer simulations. 

The occurrence of invariant sets, as shown in Figure ^ an d their relation are investigated 
in two-parameter space with respect to (6, a). First, the line m = is a invariant set of 
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Fig. 1 - Transition of overlap m(t) and variance of crosstalk noise ar(t) is shown for a — 0.065, 8 = 
1.20, T = 0. Fixed points P,P',Q are from stationary state equations, (a) Results by theory, (b) 
Results by simulation. 



the macroscopic state equations, and the dynamic structure of this invariant line obeys a 
one-dimensional map with respect to R as 

= 1 + — (l-2cxpf- °\ -)) . (20) 

na I \ 2aR(s — 1, s — 1) / J 

Figure^a) shows a two-parameter bifurcation diagram of the invariant line m — 0. This map 
satisfies the unimodal for almost all regions in the parameter space (8, a). As 6 decreases, a 
period-1 attractor Q bifurcates to a period-2 attractor Q2 and evolves into a chaotic attractor 
by the period-doubling cascade. The Lyapunov exponent at a = 0.01, 9 = 0.5 is positive i.e. 
0.035. From the point of view of an associative memory, chaotic behavior can be observed 
while the associative memory fails to retrieve the stored patterns. 

Next, we construct a two-parameter bifurcation diagram where the initial state is away 
from the invariant line, i.e. m f» 1, and analyze the coexistence with these attractors in the 
all-phase space. In regions A and A' in Figure Efb), there exists only a period-1 attractor Q 
on the invariant line. In region D, a period-1 attractor Q and a period-2 attractor Q2 exist 
on the invariant line. In these cases, since the stored patterns are all unstable, the associative 
memory fails to retrieve from any initial state. 

In region B, both a period-1 attractor Q on the invariant line and a period-1 attractor 
P near m = 1 coexist. In this case, since the stored patterns are stable, the associative 
memory can succeed in retrieving when the state is in the basin of the attraction of P. Also 
in region B' , both the attractor Q and a period-2 attractor P2 coexist. The attractor P2 is a 
sign-reversing state near the line m = ±1. In this case, the stored patterns are unstable, and 
the memory retrieves the stored pattern and its reverse one by turns when the state is in the 
basin of attraction of P2. 

In region C, both a period-2 attractor Q2 on the invariant line and a quasi-periodic or 
chaotic attractor near m = 1 coexist. In this case, although the stored patterns are unstable, 
a quasi-periodic or chaotic attractor exists. This state, therefore, goes to the attractor instead 
of the memory state. Since the overlap is non-zero, the associative memory neither completely 
succeeds nor fails to retrieve. 

The coexistence, as stated above, can be explained by characteristic bifurcations occurring 
on the boundary between the regions. On the boundary A — >■ B, a saddle node P' and a 
period-1 attractor P are generated via the saddle node bifurcation, and then both Q and P 
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coexists. They are separated by the basin boundary constituted by P' . On the boundary 
A' — > B' , similarly, a period-2 saddle node P' 2 and a period-2 attractor P2 are generated via 
the saddle node bifurcation, and then both Q and P2 coexists. On the other hand, on the 
boundary B — > C, a period-1 attractor P evolves into a repellor via the Hopf bifurcation, 
and a quasi-periodic attractor is generated around the repellor. The quasi-periodic attractor 
is sometimes phase-locked, and then it evolves into a more complex quasi-periodic attractor 
via the Hopf bifurcation again. After that, the repellor inside the quasi-periodic attractor 
evolves into a snap-back repellor |24| and a belt-like chaos appears. Finally, the belt-like chaos 
grows wider and becomes a thick chaotic attractor including the repellor P. On the boundary 
C — > D, the chaotic attractor vanishes by a boundary crisis |25| . since it comes into contact 
with the basin boundary constituted by P' . Therefore, in region D, only a period-2 attractor 
Q2 on the invariant line exists. 

Let us discuss the mechanism of occurrence of chaos at the macroscopic level in this model. 
Only one order-parameter, m(s), dominates the macroscopic behaviors of the present system 
without the frustration of interaction, that is, in the case that the number of the stored 
patterns is finite (a = 0). We can easily show that there is no chaotic attractor in this case. 
That is, the chaotic attractor appears when the system has frustration, i.e., a^O. While the 
local field hi(s) obeys distribution of (5-function when a = 0, it obeys the Gaussian distribution 
with the variance aR(s, s) when a^O. Because of this finite value of variance of the local field 
distribution, the processing units, whose absolute values of the local field hi{s— 1) are around 
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the non-monotonicity 8, take different values similarly to Bakers' Map. This is intuitive reason 
why the chaos occurs in this model with the frustration. Non-trivial things we found are that 
the chaos appears also in the case of a —> and the phase is completely different from the 
case of a = 0. Although the variance of the local field, aR(s, s), converges to in the case of 
a — > 0, the order-parameter i?(s, s) can take finite values and can behave chaotic in this case. 

On the other hand, Sompolinsky et al. discussed chaotic behaviors of a random neural 
network by the gain parameter g J with nonlinearity g and the variance of couplings J 2 /N. 
The frustration exists in the network when J > 0. For some g the chaotic behavior appears 
when J > l/g and it does not appear when < J < 1/g. That is, chaos dose not always 
appear even if the network has frustration. Therefore, we have found chaos in the frustrated 
system, namely, frustration-induced chaos. 

In summary, we considered the sequential associative memory model consisting of non- 
monotonic units, which is a large-degree-of-freedom system, and derived macroscopic state 
equations by the path-integral method in the frustrated case. The results obtained by theory 
agreed with the results obtained by computer simulations. We constructed two-parameter 
bifurcation diagrams and explained the structure of the bifurcations. The chaos at the macro- 
scopic level can become low-dimensional, since the macroscopic state equations obey the two 
parameters. The chaos in the model is induced by the non-monotonicity and the frustration. 
Since we would like to show that the occurrence of the chaos is not caused by temperature 
but frustration, the case of absolute zero temperature T = has been discussed in this Letter. 
The case of finite temperature T > will be appeared elsewhere. 
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